Visual Prosody: Facial Movements Accompanying Speech
نویسندگان
چکیده
As we articulate speech, we usually move the head and exhibit various facial expressions. This visual aspect of speech aids understanding and helps communicating additional information, such as the speaker’s mood. In this paper we analyze quantitatively head and facial movements that accompany speech and investigate how they relate to the text’s prosodic
منابع مشابه
Audiovisual representation of prosody in expressive speech communication
Prosody in a single speaking style – often read speech – has been studied extensively in acoustic speech. During the past few years we have expanded our interest in two directions: 1.) Prosody in expressive speech communication and 2.) Prosody as an audiovisual expression. Understanding the interactions between visual expressions (primarily in the face) and the acoustics of the corresponding sp...
متن کاملDoes the Face Say what the Mouth Says? A Study of Infants’ Sensitivity to Visual Prosody
The linguistic input that infants are exposed to directly shapes the languages that they acquire. After all that is why particular babies learn Arabic, Bantu, Cantonese, or Zulu. The only access that infants have to formal properties of their languages—phonology, morphology, lexical knowledge, syntax, semantics, and pragmatics—is from their everyday exposure to conversation. One crucial objecti...
متن کاملProsody in the Auditory and Visual Domains: A Developmental Perspective
The development of body movements such as hand or head gestures, or facial expressions, seems to go hand-in-hand with the development of speech abilities. We know that very young infants rely on the movements of their caregivers' mouth to segment the speech stream, that infants' canonical babbling is temporally related to rhythmic hand movements, that narrative abilities emerge at a similar tim...
متن کاملEmotion in the voice influences the way we scan emotional faces
Previous eye-tracking studies have found that listening to emotionally-inflected utterances guides visual behavior towards an emotionally congruent face (e.g., Rigoulot and Pell, 2012). Here, we investigated in more detail whether emotional speech prosody influences how participants scan and fixate specific features of an emotional face that is congruent or incongruent with the prosody. Twenty-...
متن کاملModeling Multimodal Behaviors from Speech Prosody
Head and eyebrow movements are an important communication mean. They are highly synchronized with speech prosody. Endowing virtual agent with synchronized verbal and nonverbal behavior enhances their communicative performance. In this paper, we propose an animation model for the virtual agent based on a statistical model linking speech prosody and facial movement. A fully parameterized Hidden M...
متن کامل